Using Sequence Mining Techniques for Understanding Incorrect Behavioral Patterns on Interactive Tasks

Interactive tasks designed to elicit real-life problem-solving behavior are rapidly becoming more widely used in educational assessment. Incorrect responses such can occur for a variety of different reasons as low proficiency levels, metacognitive strategies, or motivational issues. We demonstrate how behavioral patterns associated with incorrect can, part, be understood, supporting insights into the sources failure on task. To this end, we make use sequence mining techniques that leverage information contained time-stamped action sequences commonly logged assessments interactive (a) investigating what distinguishes from correct ones and (b) identifying subgroups examinees similar patterns. Analyzing task Programme International Assessment Adult Competencies 2012 assessment, find heterogeneous than ones. identify multiple patterns, which point toward levels effort lack subskills needed solving Albeit focusing single task, meaningful major differences approach given generalize across uncovered. Implications construction analysis well design interventions complex skills derived.